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1 Introduction 

With the success of entropy in classical ergodic theory it became a natural problem to 
extend the entropy concept to operator algebras. In the classical case we are given a 
probability space (X, B, fi) together with a measure preserving nonsingular transformation 
T of X. If P = {Pi, . . . , Pfc} is a partition of X by sets in B then the entropy of P is 



i=l 



where rj is the real function on [0, oo) defined by 77(0) = 0, ri{t) = —tlogt. One shows 
that the limit 

1 n— 1 

(1.2) H{P,T) = lim -h( V T-'P 

exists and define the entropy of T by 

(1.3) H{T) = sup H{P,T) , 



p 



where the sup is taken over all finite partitions P as above. Since T defines an auto- 
morphism ut of L°°(X, i3, /i) by aT{f){x) = f(T~^{x)), x G X, the entropy definition 
immediately extends to an entropy H{aT), where in the definition we replace P by the 
finite dimensional subalgebra of L°°{X,B,ix) spanned by the characteristic functions XPi- 
If we want to extend this definition to the noncommutative setting the obvious first 
try is first to define the entropy H^{N) of a finite dimensional algebra with respect to 
a state ip. Then by analogy with (|1.2|) and (|1.3|) if a is a (y9-invariant state, to consider 

1 r 

^Hip{ V ct*!^))) where \/ Ai stands for the von Neumann algebra generated by the 



algebras Ai, . . . ,Ar. This approach does not work, because the C*-algebra generated 
by two finite dimensional C*-algebras need not be finite dimensional. There have been 
several approaches to circumvent this difficulty. We shall consider the two we consider 
most successful. The first was initiated by Connes and St0rmer ||C-S|| and consisted 
of defining a function H{Ni, . . . , X^) on finite families Xi, . . . , X^ of finite dimensional 
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subalgebras of a von Neumann algebra with a normal tracial state, which satisfies many 
of the same properties as the entropy function H{Ni V ■ ■ ■ V N^) in the abelian case. This 
was possible due to the beautiful properties of relative entropy of states and the function 
T]{t). Later on Connes, Narnhofer and Thirring ||CN'1'|| extended this definition to entropy 
with respect to invariant states on C*-algebras. 

The second approach due to Voiculescu is a refinement of the mean entropy de- 
scribed above. Instead of starting with a finite dimensional subalgebra N and looking at 

ra-l 

V a^{N), he considered finite subsets u of the von Neumann algebra and then looked 



n-l 

for finite dimensional subalgebras which approximately contained IJ a^{uj). Then the en- 



tropy, or the rank, of this algebra was used in the definition. There are several variations 
of this definition depending on how the approximation is taken. They all majorize the 
C-S or CNT-entropies indicated in the previous paragraph. 

The two definitions behave quite differently with respect to tensor products. The 
CNT-entropy is superadditive, i.e. h{a ® /3) > h{a) + h{P), while those of Voiculescu are 
subadditive. In many cases the two entropies coincide, so that the tensor product formula 
h{a (3) = h{a) + h{(3) holds. 

Having the different definitions of entropy the natural question is: what do they tell 
us about the automorphism? In the classical cases in addition to being a good conjugacy 
invariant, entropy roughly measures the amount of ergodicity of the transformation and 
how fast and how far finite dimensional subalgebras are moved with increasing powers of 
the transformation. In the noncommutative situation much the same is true, except for 
one major difference. The entropy also measures the amount of commutativity between 
finite dimensional subalgebras and their images under the action. Thus in highly non- 
commutative cases like infinite free products of an algebra with itself and the shift, the 
entropy is zero even though the shift is extremely ergodic. On the other hand, shifts on 
infinite tensor products behave like classical shifts. 

The aim of these notes is to describe all the above in more detail together with the 
most studied examples. They will usually be introduced in places where they illustrate 
and show applications of the theory. We shall rarely give complete proofs, but will indicate 
the main ideas in many cases in order to exhibit the mathematical techniques and ideas 
involved. The bibliography is not meant to be complete; we have as a rule tried to include 
references to papers directly related to the text. For other approaches and references see 



The notes are organized as follows 

In Section 2 we treat the entropy of Connes and St0rmer on finite von Neumann 
algebras. We start with the background on the operator concave function 7]{t) and relative 
entropy. Then we define the entropy function H{Ni, . . . , Nk) and discuss its properties. 
After defining entropy of a trace invariant automorphism and stating its basic properties 
we illustrate the results by looking at noncommutative Bernoulli shifts. 

Section 3 is devoted to the extension of Connes, Narnhofer and Thirring of the results 
in Section 2 to automorphisms and invariant states of C*-algebras. They replace the 
entropy function H{Ni, . . . , Nk) by a similar function -ff (71, . . . , 7fc) defined on completely 
positive maps 71, . . . ,7a; from finite dimensional C*-algebras into the C*-algebra. 
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In Section 4 we consider the example which has attracted most attention in the theory, 
namely quasifree states of the CAR-algebra and invariant Bogoliubov automorphisms. 
The formula for the CNT-entropy we shall discuss, has been gradually extended to more 
general situations, starting with [|SV|| and now being completed in [^. 

Section 5 is devoted to the entropy of Sauvageot and Thouvenot |p-T|| . This entropy 



is a variation of the CNT-entropy, and they coincide for nuclear C*-algebras and injective 
von Neumann algebras. As an illustration type I algebras are considered in some detail. 

In Section 6 we define and study Voiculescu's approximation entropies together 
with Brown's extension ||Brl|| of topological entropy to exact C*-algebras. These entropies 
majorize the CNT-entropy and comparison of them can yield much information on the 
C*-dynamical system under consideration. 

Section 7 is devoted to crossed products. If {A, ip, a) is a C*-dynamical system, i.e. 
A is a C*-algebra, (p a state and a a (/^-invariant automorphism, then a extends to an 
inner automorphism d of A x Z. Using the theory from Section 6 we obtain results, even 
in more general situations, to the effect that the entropies of a and a are the same. In 
particular the shift on Ooo has topological entropy zero. 

In Section 8 we study the most noncommutative setting, namely shifts on infinite 
free products {*Ai, *ipi) where the Aj's and the y^j's are equal. These automorphisms are 
"extremely" ergodic, but still their entropies vanish. 

Section 9 is devoted to binary shifts on the CAR-algebra, arising from sequences of O's 
and I's. Different bitstreams give rise to C*-dynamical systems of quite different nature. 
The entropies with respect to the trace are in most computed cases equal to |log2, but 
there are examples with entropy zero. 

In Section 10 on generators we consider W*-dynamical systems (M, r, a) with M 
a von Neumann algebra with a faithful normal tracial state r, where the entropy is a 
mean entropy. In such cases the C-S entropy tends to coincide with one of Voiculescu's 
approximation entropies. The concept of generator can be made quite general, and we get 
in some cases the analogue of the classical formula when the entropy of a transformation 

oo oo 

T is the relative (or conditional) entropy H{\/ T^^P \ \/T^^P). Applications are given 

1 

to subfactors and the canonical endomorphism F on the hyperfinite Ili-factor defined by 
an inclusion of subfactors of finite index. 

Finally, Section 11 is devoted to the variational principle. Several of the well-known 
results from the classical case and from spin lattice systems in the C*-algebra formalism 
of quantum statistical mechanics are extended to a class of asymptotically abelian C*- 
algebras. 

Acknowledgement. The author is indebted to S. Neshveyev for several useful com- 
ments. 



2 Entropy in finite von Neumann algebras 

In this section we shall define and sketch the proofs of the main properties of the entropy 
function H{Ni, . . . , Nk) and the corresponding entropy of a trace invariant automorphism. 
For this we need to study the function rjit) = —t logt, t > 0, rj{Q) = 0, and relative entropy 



in some detail. The first goes back to early work on entropy of states, see |N-U|. Recall 
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that B{H) denotes the bounded hnear operators on a Hilbert space H, and B{H)'^ the 
positive operators in B{H). 

Lemma 2.1 (i) The function \ogt is operator increasing on B{H)^ , i.e. if < x < y 
in B{H)^ then logx < logy. 

(ii) The function ri{t) is strictly operator concave on B{H)^ , i.e. 

r]{\{x + y))>\r]{x) + \r,{y), x,y e B{H)+ 

with equality only if x = y. 

Proof For t > 



oo 



log t = / ( -— — ) dx 

^ ' \l + x t + x' 







providing (i). Multiplying by t we get 



oo 





When we take convex combinations, the first two summands cancel out, so the lemma 
follows from the inequality 

for positive invertible operators z and w. □ 

Instead of using partitions of unity consisting of orthogonal projections as in the 
classical case it will be necessary to look at more general partitions of unity. 

Notation 2.2 Let M be a von Neumann algebra, and let k eN. Then 

Sk = Sk{M) = : G M+ and equal to 

except for a finite number of indices, Yl ^h-.-ik ~ ^} 



il...ik 



Let for j G {1, . . . , A;} 

One can then show the following inequality |[H-S| . 



Lemma 2.3 Let M be a von Neumann algebra with a normal tracial state r. Let \\x\\2 
t{x*xY^'^ for X G M. Let (xij) G 5*2, i = 1, . . . ,m, j = 1, . . . , n. Then 



where [a, h] = ah — ha. 
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In particular the left side of the inequality is nonnegative. This follows also from the 
joint convexity of relative entropy, defined as follows: li x,y E with x < Xy for some 
A > 0, 

(2.1) S{x,y) = T{x{\ogx -log y)) . 

More generally if M is a von Neumann algebra and (p, ip normal states we can define 
their relative entropy as follows, @, |P-P|| . We may assume ip and ip are vector states 
and respectively and for simplicity that is separating and cyclic for M. We 
define 

Sti)^Lp{x^ip) X 
If S^^ is the closure, the relative modular operator is 

A Q* Q 

Then the relative entropy is 

S{p,i)) = -(logA^,^^^,^^) . 

There are also integral formulas due to Pusz, Woronowicz and Kosaki which yield gener- 
alizations to C*-algebras, see ||0-P|| . One can show that S is jointly convex in (f and ip 
and S{X(p, Xip) = XS{!f,ip). Furthermore, if x G M"*" and S is given by then 

S{x, t{x)) = r(a:;(log x — log t{x)) = ri{r{x)) — rrj^x) . 

This together with joint convexity of S yields the inequality 

(2.2) r]T{x + y)- Tr]{x + y) < (?7r(x) - Tr]{x)) + {riT{y) - Tr]{y)) . 

li if is a. normal state on M then there exists a positive self-adjoint operator /i<^ G 
L^{M, t) such that ip{x) = T{h^px). Then the relative entropy of ip and uj is given by 

S{ip,u) = S{h^,h^) = ipilogh^ - hgh^) 

whenever it is defined. 

If C M is a von Neumann subalgebra we denote by the trace invariant condi- 
tional expectation of M onto defined by the identity 

T{E^{x)y) = r{xy) for x G M, y E N . 

If (f and uj are normal states of N and M respectively we have, see |P-P| , Thm. 5.15], 

(2.3) S{uj, LP o Ejv) = S{uj\n, p) + S{uj, UJ o Ej^) . 
If p,tp,u; e M+ andu;<tp then by fj^ , Cor. 5.12] 

(2.4) S{p,^)<Sip,uj). 

After these preliminaries we now define the entropy function H{Ni, . . . , N^). 
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Definition 2.4 | C-S | Let Ni, . . . ,Nk be finite dimensional von Neumann subalgebras of 
M. Then 

k 

H{N,, ...,Nk)= sup [Yl Vr{x^,...^,) - ^^rr7(E^^4)} . 

^u--fee-^fc j=i ij 

The definition can be rewritten in terms of relative entropy as follows. Write for 
Let r(j) and t-, denote the positive linear functional 

= r(x(i)a), T^.{a) = r(x^^.a) . 

Since 

= r(£;^(4)(logE^^)-logE^(l))) 

the definition of H becomes 

k 

(2.5) H{N„ . . . , AT,) = sup { 5^ r7r(,) (1) + 5(r^ , ^k, ) } • 

(^(')) (i) i=i 

The main properties of H are summarized in 

Theorem. 2.5 ||C-S|| For finite dimensional von Neumann subalgebras N, Ni, Pj of M 
we have 

(A) H{Ni, ... ,Nk)< H{Pi, ... ,Pk) when N, C Pi, i = 1, . . . , k. 

(B) H{N,,... ,Nk,Nk+i,... ,N,)<H{N,,... ,N,)+H{Nk+i,... ,Np) 

(C) iVi,... ,NkCN^H{Nu...,Nk,Nk+u... , N^) < H{N, N^+u ■ ■ ■ , Np) 

(D) For any family of minimal projections of N, {ej)j^i, such that = ^ we have 

k k 

(E) If Pi pairwise commute, Pi C Ni, and \/ Pi = \/ Ni then 

i=l i=l 



H{N,,... ,Nk) = H(^\jNi 

i=l 
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Indication of proof 

(A) A variant of Jensen's inequality states that ri{Ei\f{x)) > EN{r]{x)) for x G M"*". If 
N, C thenr]{ENXx)) = r]{EN^Ep^{x)) > EnMEpX^)), hence Tr]{ENXx)) > Tr]{Ep^{x)), 
proving (A). 

(B) This is a reduction to subadditivity of H{P) in the classical case. 

(C) This is a consequence of the positivity of the left side of the inequality in Lemma |2]3 . 

(D) The proof of this property is helpful in understanding the need for the second sum 
in Definition p^ . Let (ej)jg/ be as in (D). Let {xi) e ^i. Since T{xi) = T^E^Xi), we may 



assume Xi & N. Thus we have to show 

^r/r(xi) -^T7]{xi) < '^Tr]{ej) . 

i i j€l 

By inequality (|2.2| ) we can reduce to the case when each Xi is of rankl, i.e. Xi = XiPi 
with Xi > 0, Pi a minimal projection in A^. Computing and noting that r]{pi) = we have 

^{riT{xi) - Tr]{xi)) = ^{vT{XiPi) - Tr]{XiPi)) 

If we write A^ as a direct sum of factors, we reduce to the case when A^ = M„(C), n eN, 
so that 

hence X] -^i = '"^^ so 

EAir/(r(p,)) = n-r/(^^j = log ri = Er7r( 



(E) This property shows that the definition of H generalizes the abelian case. In the 
proof we can replace each Aj by Pj. If Ai is a masa, i.e. a maximal abelian subalgebra of 

k k / ^ \ 

Pj, and A= \/ Ai'is the masa they generate in \/ P^, then by (D), H(A) = H( \/ Pj j. 

i=l i=l ^i=l ' 

Thus (E) follows from the abelian case. □ 

The function (A^i, . . . , A^t) H{Ni,... ,Nk) is from the above a function of the 
sizes of the A^j's together with their relative positions. It seems to be very difficult to 
formulate a general theorem in the converse direction. One simple result follows from 
(D), namely if P C A^ and H{P) = H{N) then each masa in P is a masa in A^, i.e. 
rankP = rank A^, where the rank of A^ — rank A^ = dim A, where A is a masa in A^. Note 
that dim A^ < (rank A^)^. So far the only theorem in the literature along the line discussed 
above is 
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Theorem. 2.6 |P-S|| Let M and t be as before. Let Ni, . . . , be finite dimensional 

k 

von Neumann subalgebras of M, and let N = \/ Ni. Then the following two conditions 

i=l 

are equivalent. 

(i) H{N^,... ,Nk) = H{N) 

k 

(a) There exists a masa A G N such that A = \/ {Ad Ni). 

i=l 

In particular, if the above conditions hold then N is finite dimensional, and 

k 

rank < H rank Ni . 

i=l 

Note that the imphcation (ii)^(i) is an easy consequence of Theorem 2.5. Indeed 

H{N) > H{N,,...,Nk) by (C) 

> H{AnN,,... ,AnNj,) by (A) 

k 

= H(^\/{AnN,)) by(E) 

1=1 
= H{A) 

= H{N) by (D) 

For the converse we must attack the definition of H, Definition p.4| , directly. Choose 
G Sk for which the right side of Definition |2.4| almost takes the value H{Ni, . . . , Nk). 
By using the fc-dimensional version of the inequality in Lemma 2J it follows that the 
operators x^^ almost commute for different j's, and taking limits of such families G 5*^ 

we can conclude that the x^. belong to pairwise commuting algebras Pj. Taking masas 

k 

Aj in these Pj we get the desired A as A = \/ Aj. □ 

j=i 

In the classical case two finite dimensional algebras A and B (identified with the 
partition of unities of their atoms) are said to be independent if [i{fg) = fJ^{f)f^{g), 
f E A, g & B , OT equivalently H{A \/ B) = H{A) + H{B). This equivalence is false in the 
noncommutative case. However, we have 

k 

Corollary 2.7 FSH Let Ni,...,Nk C M as before and put N = V A^^. Then the 

i=l 

following two conditions are equivalent, 
(i) H{N) = H{N,, . . . , iVfc) = E H{N,) . 

i=l 

(a) There exists a masa A C N such that Ai = An Ni is a masa in Ni for each i, and 
Ai, . . . ,Ak are independent. 

We shall next consider continuity of H. 
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Definition 2.8 If N,P C M are finite dimensional subalgebras t/iezr relative entropy is 



H{N\P) = sup Y^i^viEpXi) - T7]{ENXi)) 
xesi . 

(If we compare with the classical situation we should perhaps rather have used the 
name "conditional entropy"). The following properties are immediate consequences of 
Definition U 

(F) H{Nu ... ,Nk)< H{Pu ... ,Pk) + E H{N,\P,). 

(G) H{N\Q)<H{N\P) + H{P\Q). 

(H) H{N\P) is increasing in and decreasing in P. 

li N D P the definition makes sense even when and P are infinite dimensional, as 
noted by Pimsner and Popa [p-P|| . They computed H{N\P) in several cases relating it 



in particular to the Jones index, see Section 10. 

In the classical case the crucial result which makes entropy useful, is the Kolmogoroff- 
Sinai theorem, see BH| for a natural proof using continuity of relative entropy. Continuity 



in our case takes the form of the following lemma. For N, P C M and 5 > we write 
N C.^ P if for each x E N, \\x\\ < 1, there exists y E P, \\y\\ < 1, such that ||x — y\\2 < 5. 

Lemma 2.9 ||C-S|| Let M and r he as before and n G N, e > 0. Then there exists 5 > 
such that for all pairs of von Neumann subalgebras N, P G M we have: 

dimiV = n, N d P ^ H{N\P) < e . 



Definition 2.10 [|C-S|| Let a be an automorphism of M which is r-invariant, i.e. Toa 
T. If N is a finite dimensional von Neumann subalgebra of M, put 

H{N, a) = lim rH{N, a{N), ... , a''-\N)) . 



This limit exists by property (B), see [|W| , Thm. 4.9]. The entropy Hr{a), or H{a), of 



a IS 



H{a) = snpH{N,a) , 

N 

where the sup is taken over all N as above. The Kolmogor off- Sinai theorem takes the 
form, see [|W| , Thm. 4.22] for the classical analogue. 

Theorem. 2.11 [ P-S|| Let M be hyperfinite, and r and a as above. Let -PjOjgn be an 



increasing sequence of finite dimensional subalgebras of M with ( IJ -^i ) ~ Then 

\j=i 



H{a) = lim H{Pj,a) 

j— ►oo 
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Proof. Let C M be finite dimensional and e > 0. By hypothesis and Lemma 2^ there 
exists j G N such that H{N\Pj) < e. Thus by property (F) 

1 



k-li 

fc— 1 

< hmiif(P,,a(P,),... ,a^-i(P,))+hmi^i7(a'(Ar) 

1=0 



H{N,a) = \im-H{N,a{N),... ^a^-^N)) 

k K 



□ 



It is clear that H{a) is a conjugacy invariant, i.e. if 7 is an automorphism of M then 
H{^a^-^) = H{a). 

In the classical case we have H{a^) = \p\H{a) for p G Z. In our case we have, 

Proposition 2.12 (z) H{aP) < \p\H{a). 

(a) If M is hyperfinite, Hi^a^) = \p\H{a). 

Note also that by property (C) H{a) is monotone, i.e. if C -R is a von Neumann 
subalgebra such that a{N) = N, then H{a\N) < H{a). 

A problem which has attracted much attention in noncommutative entropy is that of 
additivity under tensor products. If (Mj, Oj, Tj) are W*-dynamic systems like (M, r, a) 
above, i = 1,2, then the problem is whether 

This is well-known in the classical case. In our case we can only conclude that 

(2.6) ^^ri®r2 ("1 ® tt2) > ^ri ("l) + ("2) • 

Indeed, if Ni C Mi, Pi C M2, i = 1, . . . ,k are finite dimensional then there are more 
families = (xij,... ,XiJ G Sk{Mi (g) M2) then there are families ® = 

(l/n...jfc ® -2ii...iJ in Sk{Mi) (g) ^^(Ma), hence 

Hr,®rANl ®Pl,...,Nk®Pk)> Hr,{Ni, . . . , A^fc) + if.,(Pl, . . . , Pfc) . 



Remark 2.13 The n-shift The first nontrivial example that was computed was the 
entropy of the n-shift. Let ri G N, Mj = M„(C), i G Z, and Xj be the tracial state on 
Mi. Let B = ^ Mi., T = ^Ti, be the C*-tensor product, and consider P as a subalgebra 

of the Ill-factor R obtained from the GNS-representation of r. Let a be the shift on B 
identified with its extension to R. Let 

j 

Pj = ■ ® 1 ® (g) Mi ® 1 (g) ■ ■ ■ , J G N 

~j 

be the finite tensor product of the Mj from —j to j considered as a subalgebra of P. Let 
Di be the diagonal in Mj and 

P'pg = ■ ■ ■ ® 1 ® (g) /^i ® ■ ■ • , J G N . 
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As an illustration of the techniques developed we give two computations of H{a). The 
first which is the original from ||C-S|| , is quite helpful in understanding Definition Let 
Cj be the minimal projection in Di which is 1 in the j'th row. Let 

Xn...it, = ■ ■ ■ ® 1 ® O ■ ■ ■ (g) (g) 1 G Difc . 
Then {xi^^,„^i^) e Sk, and 

= ■ ■ ■ (g) 1 (g) Cj, (g) 1 (g) ■ • ■ G . 

Thus 



H{M,,a{M,),... ,a^-\M,)) = H{M^,...,M> 



k 



k n 

> VriXi„..^J -^Yl 

ii...ik j=l ij=l 

= k log n — , 

so that if (Ml, a) > logn. 

To prove the opposite inequality we use that (Mi U M2 U ■ ■ ■ U M^)" is a factor of 
type Ink, hence has entropy A; logn. The rest of the proof consists of an application of the 
Kolmogoroff- Sinai theorem to the sequence (Pj) together with an application of property 
(E). 

The other proof is quicker. Fix g G N. Then Ag = D^g g is a masa in Pg. If A; G N let 

k-l fc-1 

A = y a^{Ag). Then A = D^g g+^-i is a masa in \/ a^^Pg) such that Ana^{Pg) = a^{Ag) 
j=o ' 

is a masa in a^{Pq). Thus by the easy part of Theorem p.6| , 

H(Pg, a) = lim ^ logn = logn , 

so that by the Kolmogoroff- Sinai theorem, H{a) = logn. 



2.14 Bernoulli shifts The above arguments can be extended to noncommutative 
Bernoulli shifts of the hyperfinite Ili-factor R. Let h G Mq with Tr(/i) = 1, Tr denoting 
the usual trace on M„(C), with eigenvalues hi, . . . , hn- Let lpq be the state ifQ^x) = Tr(/ix) 
for X G Mq. 

Let = ipo on Mj and = v^j denote the corresponding product state on i? = 

Mj. In the GNS-representation of B due to if the centralizer R of the weak closure is 

the hyperfinite Ili-factor and contains the algebras Ag above. Since a is (/^-invariant, the 
extension of a to the GNS-representation restricts to an automorphism of R, which we 
call a Bernoulli shift. A slight extension of the argument from 2.13 shows that 

n 

1=1 



11 



where S{ipo) is the entropy of the state (pQ on M„(C). □ 

There is another natural definition of Bernoulh shift on R. Let T be a (classical) 
Bernoulli shift on a probability space {X,B,fi). Then R = L°°{X,B,fi) x-p Z, and T 
extends to an inner automorphism Ad ut on R. Both the von Neumann algebra generated 
by the Aq^s above and L°°(X, B, /i) are Cartan subalgebras of R, i.e. they are masas whose 



normalizers generate R, hence they are conjugate by [|CFW|] . Thus we have one outer and 
one inner automorphism on R which act as the same Bernoulli shift on a Cartan subalgebra 
and have the same entropy (see Theorem 7.1 below). 

Other extensions of classical shift automorphisms have been studied by Besson ||B[ for 
Markov shifts and Quasthoff Q. In all examples there is a masa like A in 2.19 and the 
entropy is the same as the classical counterpart. 



3 Entropy in C*-algebras 

After the appearance of [|C-S|| an obvious problem was to extend the definition from the 



tracial case to that of general states. It took 10 years before Connes [ pql saw what had 
to be done. If one looks at the rewritten form of H{Ni, . . . , N^) in equation 2.5 and notes 
that states are of the form (p{x) = T{hx), h G L^{M, r) + , it is obvious what to do. Let ip 
be a normal state of a von Neumann algebra M. Modify Notation (2.2) as follows: For 
A; e N put 

Sk,ip = {fh...ik e , «j e N , ipii...ik = except for 
a finite number of indices, = f} ■ 



Let 



If iVi , . . . ,Nk G M are finite dimensional von Neumann subalgebras we let fCo 



(3.1) H^{N,, . . . , Nk) = sup { $^r/(y,,,...,,(l)) + 5^5^5(¥.y;v,,¥^|iv,)} • 

This definition even makes sense for C*-algebras, because, as we pointed out earlier, 
Pusz, Woronowicz and Kosaki extended the definition of relative entropy to C*-algebras. 
Since C*-algebras may have no finite dimensional C*-subalgebras except the scalars, the 
definition above would only be useful for AF-algebras and their like. Connes, together 
with Narnhofer and Thirring [|CNT]] circumvented the problem by replacing the algebras 



Nj by completely positive maps 7^ from finite dimensional algebras into the C*-algebra. 
The definition is as follows. 

Let A be a unital C*-algebra with a state y?. Let iVi, ... , iV^ be finite dimensional 
C*-algebras and 7^ : Nj ^ A & unital completely positive map, j = 1, . . . , fc. Let B be 
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a finite dimensional abelian C*-algebra and P : A B a. unital positive linear map such 
that there is a state n on B with fio P = (p. Let pi, . . . ,Pr be the minimal projections in 
B. Then there are states <^i, . . . ,0r on A such that 

r 

(3.2) P{X) = J20^{^)P^, 

i=l 

and 



(3.3) <^ = '^f^{Pi) 



i=l 



is (f written as a convex sum of states. Put 

where S{(pi, ip) is the relative entropy. Let the entropy defect be 

s,iP) = Sif^)-e,iP), 

r 

where S{fi) = ^ rj{ii{pi)) is the entropy of /i. 

i=l 

Suppose -Bi, . . . , -Bfc are C*-subalgebras of B and Ej : B ^ Bj the /i- invariant con- 
ditional expectaion. Then the quadruple [B,Ej,P,fi) is called an abelian model for 
{A, 7i, . . . , 7fc), and its entropy is defined to be 

k 

(3.4) SL . 

j=i J-^ 

where Pj = Ej o Po^j : Nj Bj, and the definition of s^(Pj) is the same as for P above, 
where we replace /i by ^\bj, f ° 1j- 

Definition 3.1 ||CN '1| if^(7i, . . . ,7^,) = sup of over all abelian models. 

In the special case when A^^i, . . . ,Nk C A and 7^ : Nj ^ A is the inclusion map let 

k 

{B, Ej, P, fi) be an abelian model. We may assume B = \/ Bj. Let {pi } be the set 

j=i 

of minimal projections in Bj. Then = Pi^...iu = Pn ■ ■ -Pik) minimal 



projections in B. If we use the abbreviation following Definition |2.4| , equations ( |3.2| ) and 
can be written 

= $^/^(pw)^w • 
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Let ip(i){x) = fi{p^i))ipi{x), so ip = Y.V(i)- We have 

Ej{jP{i)) = /^(P(i))/^H)~H ' 
where pij = pf. in the notation of (2.2). Hence if x G Nj we have 

Thus 

^From the identity 

XS{p,^)=v{X) + S{Xp,^), 
as is easily shown in the finite dimensional case, we have 

n,,v\n,)} 

Note that ipi^i) (1) = pip^i)). Thus we find that the entropy of the abelian model (5, E, P, /i) 
is 

k k 

which is the same as the expression in ( [3.11 ). 

We note that if we are given (v5(i)) € 5*^^^ and A?"!, . . . , A^^ C M it is not hard to 
construct an abehan model like {B,E,P,fi) above, so that (|3.1|) defines H^{ji, . . . ,7^) 
when 7j : Nj ^ M is the inclusion map. Thus H^^'ji, . . . ,7/c) is a direct generalization 
of Hr{Ni, . . . , Nk) defined in Definition |2.4 One can show similar properties to (A)-(E) 
in Section 2, see [|CN'l] ], hence we can define the entropy of an automorphism 

Definition 3.2 | |(J1N'1| Let A be a unital C*-algehra, ip a state and a a (p-invariant 
automorphism of A. Let C he a finite dimensional C*-algebra and 'y : C ^ A a unital 
completely positive map. Then 

KAl) = 1™ 7^v(7, a o 7, • • • , ° 7) 

k—^oo K 

exists. We define the entropy of a with respect to ip to he 

h^{a) = sup h^^ail) , 
(Crt) 

where the sup is taken over all pairs (C, 7) . 
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The Kolmogoroff- Sinai Theorem, cf. Theorem 2.11, now takes the following form. 

Theorem. 3.3 [|CNT|| Let A, (f, a be as above. Suppose (r„) is a sequence of unital 
completely positive maps Tn : An A from finite dimensional C*-algebras An into A such 
that there exist unital completely positive maps an '■ A ^ An for which r„ o cr„ — > id^ in 
the pointwise norm topology. Then 

lim Va(^n) = ^vi'^) ■ 



In particular if A = [J An is an AF-algebra, and we idenitfy An with its inclusion map 

n=l 

An —>■ A, we have, 

h^{a) = lim . 



Theorem |3.3| is applicable if A is nuclear. In that case we have ||CNT| 

(i) h^{a) = h^{'ja'j~^) if 7 G Aut A. 

(ii) = \n\{h^{a), n G Z. 

(iii) If ipi and (f2 are a-invariant and A G [0, 1], /ia(pi+(i-a)(^2('^) — ^h^-^^{a) + {l—\)h^^{a). 

Definition also makes sense for normal states of von Neumann algebras. If {A, ip, a) 
is as above, and {n^, H^, is the GNS-representation of ip, and d the extension of a to 
M = Ti^{A)", then pNTj , 

(3.5) h^{a) = h^^^{a) . 

Thus we can freely move back and forth between A and M in our computations of entropy. 
If {Ai, ipi, Oi), 2 = 1,2 are C*-dynamical systems we have as in the tracial case (2.6), 

(3.6) h^^^^^i'^i 02) > h^^{ai) + h^^i'^'i) , 

because there are many more choices of abelian models to compute the left side of ( |3.6| ) 
than the right. 

In nicer cases a useful criterion for computing entropy on von Neumann algebras is to 
consider the restriction of the automorphism to the centralizer of the state. 

Proposition 3.4 ||CNT|| Let M be a von Neumann algebra and ip a normal state. Let 
Ni, . . . ,Nk be finite dimensional von Neumann subalgebras of M. Suppose they contain 
abelian subalgebras Aj C Nj fl M^, where is the centralizer in M , such that the Aj 

k ^ 

pairwise commute and A = \/ Aj is a masa in N = Vi=i ^j- Then 

3=1 



N) ■ 

A good illustration of Proposition |3.4| is the case of Bernoulli shifts as described in 
Theorem 2.14. In the notation of 2.14 the state (p = ^ (p)i ow B = ^ Mi satisfies the 

conditions of the proposition, so with a the shift, h^{a) = if<^|^^^ (q;|m^) = S{(po). 
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4 Bogoliubov automorphisms 



The main examples for which the C*-algebra entropy have been computed, are those of 
quasifree states of the CAR- and CCR-algebras and invariant Bogohubov (or quasifree) 
automorphisms. The computations and resuhs are quite similar, so for simplicity we 
restrict attention to the CAR-algebra. Let us recall the definitions. 

Let if be a complex Hilbert space. The CAR-algebra A{H) over if is a C*-algebra 
with the property that there is a linear map / —>■ a{f) of H into A{H) whose range 
generates A{H) as a C*-algebra and satisfies the canonical anticommutation relations 

a{f)aigr + aigraif) = if,g)l, f,geH, 
«(/)a(fl') + aig)a{f) =0, 

where (■, ■) is the inner product on H and 1 the unit of A{H). If < A < 1 is an operator 
on H, then the quasifree state ua on A{H) is defined by its values on products of the 
form a(/n)* . . . a{fi)*a{gi) . . . a{gm) given by 

ujaWu)* . . . a{fiya{gi) . . . a{gm)) = 6nm det{{Agi, fj)) . 

If f/ is a unitary operator on H then U defines an automorphism au on A{H), called a 
Bogoliubov automorphism, determined by 

auW)) = aiUf) . 

If U and A commute it is an easy consequence of the above definition of uja that ajj is 
u;^- invariant. We shall in this section state a formula for the entropy hi^j^{au) and indicate 
the ideas in the computation when A is a scalar operator. 

Connes suggested to the author that if oja is the trace r the answer should be 

1 o /'Stt 

(4.1) h,^au) = ^ m{Umde, 

^TT Jo 

where m{U) is the multiplicity function of the absolutely continuous part Ua of U. Then 
Voiculescu and St0rmer ||SV|| showed this and more by solving the problem when A has 
pure point spectrum. Later on Narnhofer and Thirring ||N-T1|| and Park and Shin [[P-S 



independently extended the result to more general A. Finally Neshveyev p[ settled 
the problem completely in the general case. He and Golodets | |G-1N 1|| , and before them 



Bezuglyi and Golodets P-G|| considered more general group actions than Z. 



If A has pure point spectrum there is an orthonormal basis (/„) of H such that 
Afn = ^nfn, tleN, 0<A„<1. Define recursively operators 

n 

Vo = h yn = l[{l- 2a(/,)*a(/,)) , ej^^ = a(/„)a(/„)* 

i=l 

4? = a{fn)Vn-i, e^"^ = Vn-iaifn)*, = a{fn)*a{fn) . 

(n) 

Then the eij , i,j = 1, 2 form a complete set of 2 x 2 matrix units generating a l2-factor 
M2{C)n, and for distinct n and m e-" and ey" commute. Thus A{H) ^ M2(C)„, and 
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uja is a product state uja = with respect to this factorization, where uj^ is the state 

1 

on M2(C) given by 

-"((-)) = 

In case A = Al we write uj\ for uja- Then au is t^A-invariant for all U . We consider the 
entropy h^^{au). 

Each unitary f/ is a direct sum U = Ua®Us, where Ua has spectral measure absolutely 
continuous with respect to Lebesgue measure d9 on the circle, while Us has spectral 
measure singular with respect to d6. We shall as above denote by m{U) the multiplicity 
function of Ua- The idea is now to approximate the case when 

U = Us®Ui®---®Un, 

where each f/j acts on a Hilbert space Hi, i = l, . . . ,n, and Ui is unitarily equivalent to 
VP\ where V is a. bilateral shift. Let us for simplicity ignore the complications due to the 
grading of A{H) as a direct sum of its even and odd parts. Then 

and 

ux = ujx\AiHs) ® uJx\A{Hi) ® ■ ■ ■ ® uJx\A{Hr,) . 
Thus we could hope that 

n 

(4-2) K>^{au) = K^\A{Hs){(^Us) + ^h^x\Am{au.), 

1=1 

and thus restrict attention to the case when U is singular or a power of a bilateral shift. 
We do have problems because of (|3.(j|), but life turns out nicely because we can as with 
the shift in 2.13 restrict attention to the diagonal, and the diagonal is contained in the 
even CAR-algebra, where the tensor product formulas above hold. First we take care of 
the singular part Ug. 

Lemma 4.1 IfU has spectral measure singular with respect to the Lebesgue measure, and 
au is if -invariant for a state (p, then h^{au) = 0. 

Thus in ([4.2|) we can forget about Ug. U U = with V a bilateral shift and p G Z, 
then 

KMu) = K^iiavY) = \p\Kxio:v) ■ 

oo 

If we write A{H) = M2(C)„, then on the diagonal ay is the shift, so like in 2.14, 



see also Proposition |3]^, we get 

Now IpI is the multiplicity m{U) of U, and since ^d9 is the normalized Haar measure on 
the circle, it is not surprising that we have 



17 



Theorem. 4.2 Let U be a unitary operator on H and A G [0,1]. Then h^^{au) 

^{vW + vii-x))Cmiumde. 



Note that if A = 1/2, ux = r, so we get formula ( [4.1|) . For more general A we use 
direct integral theory with respect to the von Neumann algebra generated by Ua- If A 

commutes with U, A = Aa® As, where Aa = J A{9)d9, H = J Hed9, and He = if 

m{U){9) = 0, and A{9) C B{He). 

We can now state the main theorem in this section, see ||S V| ] , | pr'-|j| |, | |1N-'1'1| ] and |Q. 



Theorem. 4.3 Let < A < 1 and U be a unitary operator commuting with A. Then 



2tt 



KAo^u) = ^j Tr{Am) + - m))de . 



Furhtermore, j^, h^^A^u) < oo if and only if A{9) has pure point spectrum for almost 
all 9 e [0,2n). 

Entropy is far from a complete conjugacy invariant for Bogoliubov automorphisms. It 
has been shown by Golodets and Neshveyev ||G-N3|| in the case of the CCR-algebra, that 



there exists a quasifree state oo and a one-parameter family ag, 9 G [0, 2-7?), of cu-invariant 
Bogoliubov automorphisms with the same positive entropy h^{a0) and such that if M 
is the weak closure of the CCR-algebra in the GNS-representation of u, then the W*- 
dynamical systems {M,uj,ag) are pairwise nonconjugate. In this case M is a factor of 
type nil and the centralizer of a; in M is the scalars. Thus the situation is quite 



different from that encountered in Proposition |3.4 Such an example had previously been 



found by Connes |Co 



5 The entropy of Sauvageot and Thouvenot 

Sauvageot and Thouvenot ||S-T]] have given an alternative definition of entropy, which is 



close to that of ||CN '1| ] , but which has technical advantages in some cases. Again we look 
at all possible ways a state can be written as convex combinations of other states. 

Let {A,ip,a) be a unital C*-dynamical system, and let {C,fi,P) be an abelian C*- 
dynamical system. A stationary coupling of these two systems is an a ® /3-invariant state 
X on A® C such that \\a = V^, Mc = If -P is a finite dimensional C*-subalgebra of C 
with atoms Pi, ■ ■ ■ ,Pr let 

V9i(x) = ni^pi)'^ \{x IS) Pi) , 
whenever yu(pj) 7^ 0, as we may assume. Then 

r 
i=l 



18 



is 1^ written as a convex sum of states. Let 

oo 

p- = \lnp); 
1=1 

then from the classical theory 

n— 1 

H,{P,P) = hm -hJ V f3\P)) = H^{P\P- 



i=0 



Definition 5.1 The Sauvageot-Thouvenot entropy h'^{a) of the system {A,ip,a) is the 
supremum over all ahelian systems (C, /5) as above of the quantities 

r 
i=l 

Note that if \ = ip ® fi then ipi = ip, hence S{ipi, ip) = 0, and H{P\P^) — H^{P) < 0. 
Thus if A = ® /i is the only stationary coupling then h'^{a) = 0, a fact we shall need 
later. 



Theorem. 5.2 |p-T|| // A, (p, a) is a C*-dynamical system with A nuclear or a W 



dynamical system with A infective then h'^{a) equals the CNT-entropy h^f,{a). 

In order to understand the relation between and h'^ better, let us prove the in- 
equality h'^{9) < h^{a) in some detail. The opposite inequality holds in general. 

Let (C, fi, (3) be an abelian system and A a stationary coupling. Let P be a finite 
dimensional subalgebra of C with atoms Pi, . . . ,Pr- Let m G N. We shall show 

r 

(5.1) h^{a) > H,{P\P-) - H,{P) + Y,^^{v^)S{ip^, ip) , 



i=l 



where ipi{x) = fj,{pi) ^X{x ® Pi). 
(fi has the decomposition 



^1 )• • • i^m 



where 

We thus have a completely positive map p : A ^ C defined by 
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m— 1 

where Pij^...i„^ = PhP{Pi2) ■ ■ ■P"^~^{Pim) ^^e atoms in B = \/ P^{P). The /i-invariant 



conditional expectation Ej : B ^ P^'iP) is determined by 

Let 7 be a unital completely positive map from a finite dimensional C*-algebra into A. 
We found above an abelian model for {A, y?, 7, « o 7, . . . , a™"^ o 7), namely {B, Ej, p, /i). 
We find 



X{x^£Hp^ 

^ pmp,^)) ^^^^^ 



by invariance of /i and A with respect to (3 and a® (3 respectively. From Definition 
we obtain 



m—l 



H^{^, a o 7, . . . , a"^-' o 7) > - J2 SWiP)) 

j=0 

m—l r 

o a o a-' o 7, o a-' o 7) 

r 

= ^(yulE) -mS'(/i|P) +m^/i(pi)S'(v9i 07,^9 07) . 



Thus 



-i/^(7, a o 7, . . . , a^-^ o 7) > E^{P\P-) - H,{P) + ^ ^i{pi)S{^^ o 7, o 7) ■ 

I 

If A is an injective von Neumann algebra or a nuclear C*-algebra we can find a net of 
maps (7^)^ such that S{ipi o 7^, o 7^) — S{ipi, ip), see |P-P| , 5.29 and 5.30]. Thus (|5.1|) 
holds, and /?.^(a;) > h'^{a). □ 

If a is an automorphism of a C*-algebra A, and i? is a C*-subalgebra of A such that 
= B, then every a-invariant state on B has an a-invariant extension to A. If we 
apply this to a stationary coupling X on N ® C we can extend X to A® C and prove the 
following result. 
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Proposition 5.3 |N-S1| Let A be a unital C*-algebra and a an automorphism of A. Let 



B be an a-invariant C*-subalgebra of A and an a-invariant state of B. Then for each 
e > there exists an a-invariant state (p of A such that ip\B = ip and h'^{a) > h'^{a\B) —£■ 

It is well-known from subfactor theory that properties of a subfactor of finite index 
often are kept by the larger factor. The following is an analogous result for entropy. 



Proposition 5.4 ||N-S1|| Let [A, ip, a) be a unital C*-dynamical system. Let B G A 



be an a-invariant C*-subalgebra with 1 E B. Suppose there is a conditional expectation 
E : A —>■ B such that E o a = a o E , ip o E = ip, and E{x) > ex for all x G A'^ for some 
real number c > 0. Then 

Proof. The inequality h'^{a) > h'^{a\B) follows by monotonicity. To prove the opposite 
inequality we consider A in its GNS-representation with respect to ip, so we may assume 
A and B are von Neumann algebras and ip and E normal. Let {C,fi,l3) be as before. 
Then ipiO E > api, hence by S{ipi, p>iO E) < S{ipi, api) = — logc. Thus by ( p. 3D 

^IJ,{pi)S{(pi,(p) = ^iJ,{p-i){S{(pi\B,(p\B) + S{(pi,(piO E)) 



It follows from Definition ^]T]that h'^{a) < h'^{a\B) — logc. But this inequality must hold 



for a'", m G N, as well. Hence 



h'^ia) = -h'^ia"') < -h'^ia'^lB) ~ -logo = h'^{a\B) --logc, 

and h'^{a) <h'^{a\B)- □ 

/^From Theorem |5.2| : 
Neumann algebras then 



/^From Theorem |5.2| it follows that if A and B are nuclear C*-algebras or injective von 



h^p{a) = h^{a\B) 



Theorem. 5.5 | |1N-S1| | // (M, (p, a) is a W*-dynamical system with M of type I and Z is 
the center of M, then hip{a) = hip{a\z)- 

Indeed, if M is homogeneous of type I and is a trace the result is immediate from 
Proposition since the center valued trace satisfies the conditions of E. The proof in 
the general case is a technical adjustment to this idea. 

By a similar argument, see | |G-N 2| | , one can show that if is an injective von Neumann 
algebra with a normal state u, and (M, ip, a) is a W*-dynamical system then 



(5.2) 



h^(^^{id(g)a) = h^{a) . 



When we apply Theorem 5.5 to inner automorphisms we obtain 
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Corollary 5.6 ||N-S1|| If {A,Lp,a) (resp. {M,Lp,a)) is a C*- (resp. W*-) dynamical 
system with A (resp. M) of type I, and a = Ad u is an inner automorphism, then 



h^{a) = 0. 



Corollary 5.7 P^ j, |[N-S1|| Let R be the hyperfinite IIi- factor, A a Cartan subalgebra 



of R and u a unitary operator in A. If ip is a normal state such that u belongs to its 
centralizer R^, then h^{Ad u) = 0. 

Proof. As pointed out in 2.14 A is conjugate to the infinite tensor product of tlie diagonals 
Di considered in 2.13| . Thus there exists an increasing sequence Ni G N2 G ■ ■ ■ of full 



matrix algebras with union dense in R such that A = An Bn, where An = Nn H A, 
Bn = N'^ n A. Then M„ = Nn ® Bn is of type 1 and contains A. By Corollary KM 



00 



h^{Ad u\m„) = 0. Since IJ M„ is weakly dense in R, h^{Ad u) = 0. □ 



n=l 



In particular it follows that if ar is the automorphism of L°°{X, B, fi) induced by an er- 
godic measure preserving transformation T and ut is the unitary in R = L°°{X, B, ^) x^j, 
Z which implements a^, and A is the masa in R generated by ut, then A is a singular masa, 
i.e. not Cartan, whenever H{T) > 0, because by monotonicity H{Ad ut) > H^ar) = 
H{T). 

A related consequence is due to Brown ||Br2|| . We say a C*-algebra A is AT if it is an 



inductive limit of circle algebras, i.e. A = IJ A,, norm closure, where Ai G A2 d ■ ■ ■ are 

1=1 

C*-algebras of the form 

k 

i=i 

where Xj is homeomorphic to either the circle T, [0, 1], or a point. 



Corollary 5.8 ||Br2|| // A is an AT algebra and B G A is a circle algebra we cannot 
always find a sequence (Ai) as above with Ai = B. 

Proof Let C = 0Mi, where Mi = M2(C), and let a be the 2-shift on C, and r the 



unique tracial state, see Remark |2.13| . Then Ht-^o) = log 2. Let A = Cx^Z (see section 7 
for the detailed definition), and let u be the unitary operator in A which implements a. 
By [ pKRSII A is an AT algebra, and by monotonicity hr{Ad u) > h^-^a) = log 2 > 0. 



However, if u belongs to a circle algebra Ai in a sequence as above, then by Corollary ^]6| 
hr{Ad u\Ai) = 0, hence hr{Ad u) = 0, which proves that the circle algebra C*(m) cannot 
be Ai in a sequence (Ai) as above. □ 



For another entropy result on AT algebras see |Pe|| . 
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6 Voiculescu's approximation entropies 

As mentioned in the introduction Voiculescu [|V|] has introduced entropies which are re- 
finements of mean entropy and which provide a very nice technique to study entropy. 

Let M be a hyperfinite von Neumann algebra with a faithful normal tracial state r. 
Let Pf{M) denote the family of finite subsets of M. Modifying the notation introduced 
before Lemma 2.9 we write u X if u e Pf{M), X C M, if for each X & u there is a 
y & X such that ||x — ?/||2 < 6. Let further JF(M) denote the family of finite dimensional 
C*-subalgebras of M. As noted in Section 2, if A G J^{M) then rank A is the dimension 
of a masa in A. 

Definition 6.1 If u e Pf{M), 6 > put 

rr{uj,6) = inf{rankA : A G J^{M),lo A} , 

called the 5-rank of uj. 

Note that a slightly different choice for Tt-^u!, 6) would be to replace rank A by exp(i/^(A)), 



see 



CD and [p^ . 



Definition 6.2 If a is a r-invariant automorphism of M and 6 > 0, uj E Pf{M) 
we put: 



n-l 



haT-{a, u, 6) = limsup — logr^ ( \^ S 

3=0 

har{a, uj) = sup ha^^a, u, 6) 

har{a) = sup{har{a,uj) : u G Pf{M)} . 

har{a) is the approximation entropy of a. 

An alternative is to take liminf in the definition of har{a, oo, S). Then we get the lower 
approximation entropy ihar{a). 

As for the previous entropies we have har{a^) = \k\har{a), k E 1^. The proof that 
haria"^) = har{a) is very easy; indeed 



n~l n— 1 n— 1 

■ ■ ■ 



The analogue of the Kolmogor off- Sinai Theorem takes the following form. 

Proposition 6.3 Let uj G Pf{M), j E N, ui C 002 C ■ ■ ■ be a sequence such that 
U U generates M as a von Neumann algebra. Then 

har{a) = sup har{a,u!j) . 
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Proposition 6.4 (i) If A e T{M) and uo G Pf{M) generates A as a C*-algehra 
then Ht-^A^o) < ihar{<y,uj) . 
(a) H{a) < ihar{a) < har^o). 

Proof. It suffices to show (i). Let e > 0. By Lemma p.9| there exists (5 > such that if 
B e J^(M) satisfies A B then H{A\B) < s. By hypothesis on u there exists therefore 
(5i > such that if uo C^^ B then H{A\B) < e. This also implies that if a^{uj) C^^ B 

n— 1 

then H{a^{A)\B) < e. Put r{n) = [j a^{uj),6i). Then there exists B G J^(M) with 



ranki? = r(n) and a^{A) C*^^ B for < j < n — 1. Hence by Property (F) in Section 2, 

n-1 
j=0 

< logr(?2) + ne , 

so that H{A, a) < har^a, uj, 6i) + e, proving the proposition. □ 

In general it can be quite difficult to know when an algebra B as in the above proof 
satisfies rank!? = r(n), hence to compute r{n). A case when it is easy is that of the 
n-shift. In the notation of Remark p.l3| let R = (^(Mj, Tj) with Mj = M„(C), and a be 



the shift. Let A = Mq G J-'{R). Let, as is often done, u he a complete set of matrix units 

_™ fc-l k-l 

for A. By Proposition]^ /ia^(a,co') = /la^(a). On the other hand |J a^^uj) C V (y^{A), 

3=0 j=0 

which is a I„fe-factor, hence 



n-1 

k 



a^iuj),6j<n'' foralU>0. 

j=0 

Thus, by the above and Proposition |6.4| har{a) = har{a,uj) < \ogn = H{a) < har{a), 
so har{a) = logn. 

One test for any definition of entropy is that it should coincide with the classical 
entropy in the abelian case. Via an application of the Shannon, Breiman, McMillan 
Theorem the approximation entropy does this [|V|]. 

We remarked in ( p.6|) that the entropy H{a) is superadditive on tensor products. For 
the approximation entropy the inequality goes the other way, i.e. 

^flri^ralai ® tt2) < /iari(«l) + /iCtrz ("2) • 

Hence to show equality it suffices to show that the two entropies coincide. In Section 10 
we shall look at such cases. 

In the above treatment of the approximation entropy the trace played a minor role. 
If A is an AF-algebra we can do essentially the same, where we now replace the distance 
II II 2 with the operator norm. Then we get the entropy Voiculesu denotes by hat (a) - 
the topological approximation entropy of a. 
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The most flexible and therefore probably the most useful of Voiculescu's approxima- 
tion entropies are the completely positive ones. We consider the von Neumann algebra 
definition first. Let (M, yj, a) be a W*-dynamical system with M injective and (p faithful. 

Let \\x\\ip = ip(x*xy^'^ be the (y9-norm on M. Let 

CPA{M, v?) = {{p,ilj,B) : B a finite dimensional C*-algebra, p: M ^ B, ip : B ^ M 
are unital completely positive maps such that ip o ^ip o p = ip] . 



Definition 6.5 If ^ ^ PfiM) and 6 > the completely positive (5-rank is 

rcp^{u, 6) 

= inf {ranks : {p,ilj,B) G CPA{M,ip), ||^ o p(x) - x\\^ < 6 for all x e u} . 



Then we continue as in Definition |6.2| to define the completely positive approximation 
entropy hcpa^{a). Again we can prove much the same results as for the approximation 
entropy har{a). 

The C*-algebra version of the above definition is like the corresponding entropy hat (a) 
independent of invariant states. Voiculescu defined this entropy for nuclear C*-algebras, 
but later on Brown ||Brl|| saw that one can develop the theory for exact C*-algebras. 



Definition 6.6 Prl|| Let A be a C*-algehra andn : A B(H) a faithful ^-representation. 
Then 

CPA{ti, A) = {{p,i), B) : p : a ^ B,^ : B ^ B{H) are contractive 
completely positive maps, B is finite dimensional C*-algehra\ 

Let uj e PfiA), 5>0. Then 

rcp{n,u!,6) = infjranki? : {p,ip,B) G CPA{7i, A), and 
Wip o p(x) — 7r(a;)|| < 6 for all x E u} . 

It follows from that the C*-algebras for which this definition makes sense are the 
exact C*-algebras. We shall therefore assume A is exact and define the topological entropy 
of a E Aut{A), denoted by ht^ir, a) as in Definition |0[ 

The first result to be proved is that the definition is independent of tt, hence we can 
define 

ht{a) = ht{7c, a) , 

or if y4 C B{H) as ht{idA, a). The proof is a good illustration of the techniques involved. 
We may assume A is unital. Let vTj : A — > B{Hi), i = 1,2, be faithful ^-representations. 
Let u G Pf{A), 6 > 0. It suffices by symmetry to show 

(6.1) rcp{7!'i,uj,6) > rcp{TT2,uj,6) . 

Choose {p,ip,B) G CPA^Hi, A) such that ranki? = rcp{7ii,uj,S), and 

o p(x) — 7ri(x)|| < 5 , X E UJ . 



25 



Consider the map o tTj^ ^ : Hii^A) — >■ B{H2). From Arveson's extension theorem for 
completely positive maps ||Ai)| there exists a unital completely positive map $ : B{Hi) — > 



B(H2) extending 712 o vr^ Thus we have (p, $ o ■?/;, 5) g CPA{ti2, A) and ||$ o ■?/; o p(a;) — 
7r2(x)|| < (5 for X G c<j, since 7r2(x) = $ o 7ri(x). Thus ( |6.1| ) follows. □ 

Again we can prove the basic properties of entropy. Note that monotonicity is an 
easy consequence of the fact that a C*-subalgebra of an exact C*-algebra is itself exact. 
The analogous result is not true for nuclear C*-algebra. We conclude this section with a 
theorem which compares the entropies defined so far. 

Theorem. 6.7 [|V| (i) If (M, r, a) is a W*-dynamical system with r a trace then 
Hr{(y) < hcpar{oi) < httria) 

(a) If {A, ip, a) is a C*- dynamical system with A an AF-algebra then ht{a) < hat{a). 
(Hi) 0, ||D2|| If in (ii) A is exact then h^{a) < ht{a). 



7 Crossed products 

If {A, 0, a) is a C*-dynamical system a natural problem is to compute the entropy of the 
extension of a to the crossed product A Xq, Z. More generally, if G is a discrete subgroup 
of Aut A and (3 G Aut A commutes with G, compute the entropy of the extension of jS 
to A X G. The first positive result is due to Voiculescu 0, who showed that for an 
ergodic measure preserving Bernoulli transformation T on a Lebesgue probability space 
{X,B,fi), H(T) = H {Ad ut), where ut is the unitary operator in L°°{X,B,fi) Z 
which implements T. Later on several extensions have appeared, see ||Brl|| , ||B-C|| , [P-S|| , 
G-N2|| . We first recall the definition of crossed products. 



Let A be a unital C*-algebra, G a discrete group, and a : G ^ Aut A a group 
homomorphism. Let a : A B{H) be a faithful nondegenerate representation. Let 

71: A ^ B{e\G, H)) ^ B{f{G)) ® B{H) 

be the representation given by 

{7r{x)0{h) = cr{ah-i{x)){^{h)) , xeA, ^ef{G,H), heG, 

and let A be the unitary representation of G on H) given by 

{\S,m = i{g-'h) , ^ef{G,H), g,heG. 

Then we have 

\g-i7!'{x)\g = TT{ag{x)) , X E A , Q & G . 

The reduced crossed product C*-algebra A G is the norm closure of the linear span of 
the set {7i{x)Xg : x E A, g & G}. Up to isomorphism A x^G is independent of the choice 
of a, so for simplicity we assume henceforth that a is the identity map. Let {C,h}heG be 
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the standard orthonormal basis in P{G), so ^h{g) = Sg,h, g,h E G. Then if ^ = in® 
with E H we have 

where ig is the left regular representation of G. Furthermore 

n{x)^ = 7r(x)(^ft o ^) = (g) ag-i{x)i) . 

By the above, since we may consider A as a subalgebra of B{P{G, H)), we may also assume 
from the outset that a is implemented by a unitary representation g — > Ug, g E G, of G. 
Thus we have 

(1 ® Ug)*n{x)\h{l ® Ug) = n{ag{x))Xh . 

For simplicity let us assume G is abelian - the argument works for G amenable. We 
follow the approach of P-S|| and ||Brl|| . Let Cp^g G B{(?{G)) denote the standard matrix 
units, i.e. 

where Sq^t is the Kronecker 5. Then we have 

7i{x)Xg = '^et^t-g®a~t{x) , xeA, geG. 

t&G 

In particular, if /3 G Aut A, and we assume as before that f3 = Ad v for a unitary 
V G B{H), then if /3 commutes with all ag then 

Ad (1 (g) f ) {n{x)Xg) = ^ et^t~g ® a-t(a;)t^* = 

Thus /3 extends to an automorphism /3 = Ad (1 ® w) of A G. 

If F C G is a finite set let Pp denote the orthogonal projection of i'^{G) onto span 
{C,t : t E F}. Then we find 

{PF®l){TT{x)Xg){PF^l) = et,t-g ® a-t{x) e Mf A , 

teFn(F+g) 

where Mf = PFB{e{G))PF. 

In order to compute the entropy of (3 on A XaG the idea is now to start with a triple 
iB,p,ip) G CPA{idA,A) and extend it to a triple (Mjt'^S, $, ^f) G GPA{idAxcG, Ax^G) 
such that we can control the estimates. If / G L°°{G) has support contained in F let mj 
denote the corresponding multiplication operator on i'^{G), and define 

t£G 
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Note that by amenability we can assume ||/||2 = 1 and / * f{gi) is close to 1 on a given 
set (?!,.. . ,gk determining F where f{g) = f{—g)- With p and ip as above we put 

^f{x) = {Pf ® 1)xPf ® 1) , xe B{f{G, H)) . 

Then ^f{A x^G) C Mf ® A, so that 

{Mf ® 5, (1 ® p) o ^f, o (1 ® ^)) G CPA(id^x„G, Ax^G) 

is the desired triple extending {B,p,ilj). Since rank(Mi? ® i?) = cardF ■ rank 5, all that 
remains is to choose F with some care depending on a given set oo G Pf{A XaG), which 
we may suppose is of the form u = {7i{xi)Xg-; i = 1,2, . . . ,n}. 

The above construction essentially works for all the different entropies considered, and 
even for (3 G Aut A commuting with all ag when G is amenable. 

Theorem. 7.1 Let A be a unital C*- algebra, G a discrete amenable group and a : G ^ 
Aut y4 a representation. Let (3 G Aut A commute with all ag, g EG. Let (3 be the natural 
extension of (3 to Aut (A x^, G). Then we have 

(i) [gg. If A IS exact then ht0) = ht{(3). 



(a) [ |Cj-1\I2| ]. If a is an injective von Neumann algebra and (f a normal state which 



is both G- and P -invariant then, if ip is identified with its canonical extension to 
A X G , 

hcpa^{(3) = hcpa^{(3) , and h^{(3) = h^{(3) . 

Note that when A = L°°{X, B, p) and (3 = ai = ar, G = Z, the theorem implies the 
result of Voiculescu alluded to in the first paragraph of the section. When G is abelian 
and j3 = Ug some g E G, part (i) was proved by Brown ||Brl|| . A variation of (ii) can also 
be found in |[B-C]| . 



Sometimes one can prove results on operator algebras by representing them as crossed 
products, see e.g. the proof of Corollary |578| . Another example is Ooo - the universal 
C*-algebra generated by isometrics {Si}i^z which satisfy the relation 

r 

J2 SiS* < 1 for all r G N . 

i=—r 

Every bijection a : Z — Z defines an automorphism, also denoted by a of O^o by a{Si) = 
Sa{i)- By ||Cu|| there exist an AF-algebra 5, $ G Aut B, an imbedding vr : Ooo —>■ B x^Z, 
and a projection p E B, such that vr(Coo) = p{B x$ Z)p. By using techniques similar to 
those used to prove Theorem [7.1| we have 



Theorem. 7.2 |[B-C | //« G Aut Oqo is induced by a bijective function a : Z ^ Z then 



ht{a) = 0. In particular, if (p is an a-invariant state on O^o then h^{a) = 0. 
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Note that the last statement follows from the first and Theorem 3/7 since h^{a) < 
ht{a), since Coo is nuclear. For a closely related result see ||C-JN|| . This theorem is the 
first we shall encounter, which shows that if a C*-dynamical system [A, ip, a) is highly 
nonabelian then the entropy of a tends to be small. 

A problem related to the above is the computation of the entropy of the canonical 
endomorphism $ of the C*-algebra On of Cuntz |Cu|, which is the C*-algebra generated 

n 

by n isometries Si, . . . , Sn such that SiS* = 1. Analogously to Ooo, On can be written 

1=1 

as a crossed product B x^N, where B = ^ with Mj = M„(C), a is the shift to the 

right, and ip the canonical state extending the trace on B. The canonical endomorphism 
$ is defined by 



^X)=J2S^XS* , XeOn 



1=1 



It is a simple task to extend the entropies and ht to endomorphisms. We have 

Theorem. 7.3 ||C4|| The canonical endomorphism $ on On satisfies 

ht{^) = /i<^($) = logn . 

The result has a natural extension to the Cuntz-Krieger algebra Oa defined by an 
irreducible n x n matrix which is not a permutation matrix. Then we have |[Bo-Gci| 

ht{a) = \ogr{A) , 



where r{A) is the spectral radius of A. For further extensions see |PWY 



8 Free products 



In Theorem 7.2 we saw that the shift on O^o has entropy zero. The first example of 



a highly nonabelian dynamical system where the entropy is zero, was the shift on the 
Ill-factor L(Foo) obtained from the left regular representation of the free group in infinite 
number of generators This phenomenon was rather surprising because the shift is so 
ergodic that there is no globally invariant injective von Neumann subalgebra except for 
the scalars. We shall in the present section study extensions of the above shift. 

We first recall the definitions. Let / be an index set, and for each l E I let A^ be a 
unital C*-algebra and ip,^ a state on Let {tt^jH^,^,) be the GNS-representation of ip^, 
L e I. Let = H,e C^, and {H, = * (^m be the free product. Put 



Hit) 



n>l 



e K 
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We have unitary operators : i/^ H{l-) — ^ H defined by 

H^(^^^H^ by r](^^^r] 

(g) ® • ■ ■ ® //°^) iff ® ® • • ■ ® by V ® ^7 ^ ® ^, ^1 7^ ^ • 

The representation : ^ B{H) is defined by 

A,(x) = V:(7r,(a;) ® 1h(o)K* , x G A • 

The free product representation tt = * tt^ : B{H) is the *-homomorphism of 

the free product C*-algebra {*A^, *AJ — B{H), using the universal property of the free 
product. When we write {A, (p) = {*Ai,, *ipi)^^i we shall mean *A^ in the representation 
TT, i.e. we shall mean 7r(*AJ C B{H). 

There are now two approaches; the first is to show that ht{a) for a the shift, or rather 
a defined via a bijection Z — >■ Z like for Ooo in Theorem \l.2[ and use the inequalities in 



Theorem 6.7 to conclude that the other entropies are zero. This works if the A^ are all 



exact, because then A is exact [pT |. 



Theorem. 8.1 | p2| | In the above notation assume each A^ is finite dimensional and let 
a be a permutation of I such that for all l E I there is an isomorphism a,, : A^ ^ ^o-(0 
such that ^a{L) o a = V^f Then there exists a unique a G Aut A such that a o A^ = Ao-{t) o a^, 
t G /, and ht{a) = 0. 

Dykema proves a more general result than the above. The theorem is not as restricted 
as it looks, because if we let = A^^ * ^21+1 we can write A as a free product ^B^ of a 
large class of C*-algebras. For example in this way we can imbed Ooo in a free product 
to recover Theorem |7]^. Similarly we can obtain the announced result on the shift of 
C*r^oo)-, and hence by ( pTSf ) of L°°(Foo), from the inequality h^{a) < ht{a). 

For the other approach we note that we have no Kolmogoroff-Sinai Theorem in the 
nonnuclear case, so we must go directly at the definition of /;,^(7i, . . . ,7n)- Recall that 
we then considered a positive map P : A ^ B, where is a finite dimensional abelian 
C*-algebra with a state /i such that fio P = (p. Denote by = fi{x*xy^'^. 



Lemma 8.2 ||S3|| Let (A, (p) = (* A, *'y5(,)t6/ be a free product of unital C*-algebras. Let 
B be an abelian C*-algebra with a state fi. Suppose P : A ^ B is a unital positive linear 
map such that fj, o P = p. Then given e > there is J C I with card J < [i^^] + 1 such 
that 

\\P{x) — ip{x)l\\^ < e\\x\\ , X G A 5 i ^ J . 

Thus P is essentially almost constant outside the subalgebra * A,^. If we now assume 

At = Aq, i G / = Z and letting for example a be the free shift on A arising from the shift 
t — i> t + 1 on Z, then it is not hard to go through the different steps in the definition of 
the CNT-entropy h^{a) to conclude: 
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Theorem. 8.3 |^3|| If Aq is a unital C*-algebra and (po a state on Aq, and Ai = Aq, 

ipi = ipo, i E Z, then the free shift a on {A, ip) = {*Ai, *(pi)i,^z has entropy h^{a) = 0. 



Remark 8.4 It should be noted that by a resuh of Avitzour [^] it follows that every 
stationary coupling extending ip is of the form \ = p ^ fi, hence the entropy h'^{a) of 
Sauvageot and Thouvenot is zero. One can further show P^] that if (C, p, 7) is a C*- 
dynamical system then 

K*p(^ * ^) = K(^) ■ 

Similar results hold for other entropies, see 



9 Binary shifts 

A rich class of C*-dynamical systems is obtained from bitstreams, i.e. sequences 
with Xn G {0, 1}. Denote by X the subset of N, X = {n G N : x„ = 1}. We can construct 
a sequence {sn)neN of symmetries, i.e. self-adjoint unitary operators on a Hilbert space 
which satisfy the commutation relations 



SiSj 



SjSi if \i — j\ ^ X, i.e. x\i_j\ = 
-SjSi if \i- j\ e X, i.e. x\i_j\ = 1, 



see e.g. 

Let A{X) denote the C*-algebra generated by the s„, n G Z. The canonical trace r on 
A{X) is the one which takes the value zero on all products Sj^ . . . where zi < ^2 < ■ ■ ■ < 
in, and r(l) = 1. We denote by a the shift automorphism of A{X) defined by = 
Sj_|_i. Then {A{X),T,a) is a C*-dynamical system. Well-known situations from both 
C*-algebras and the classical case are represented as special cases, e.g. asymptotically 
abelian, proximally asymptotically abelian, K-systems, and completely positive entropy, 
see | |G-S1[ . We shall assume we are in the nontrivial case when then set —X U {0} U X is 
nonperiodic. Let An = C*{so, . . . , s„_i) be the C*-algebra generated by sq, . . . , s„-i, so 
that 

n-l 







We list some properties of An and A{X) which will be used in the sequel, see 0, ||Po-Pr|| 
or Denote by Zn the center of An- Then we have: 

(9.1) There are c„, d„, G N U {0} such that n = 2d„ + c„ , A„ = Mgdn (C) ® Zn 
where Z„ = C({0,1}^"). 

(9.2) If e is a minimal projection in Z„ then r(e) = 2"*^". 

(9.3) There is a sequence (m^) in N such that (c„) consists of the concatenation 
of the strings (1, . . . , mj — 1, mi, mj — 1, . . . ,1,0). 
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In particular c„ = for an infinite number of n's, hence An = M2n/2(C) for these n's, and 
so A{X) is the CAR-algebra. 

(9.4) H{An) = log rank A„ = (c„ + c/„) log 2 . 
By Q 2dn<n< 2ci„ + 2c„, hence 

1 1 
liminf-if(A„) = liminf -(c„ + log2 < ilog2. 

n n n n 

Since also ^(c„ + > | we find 

(9.5) lim inf -H{An) = ^ log 2 

n n 

(9.6) lim — = if and only if hm ^HiAn) = | log2 . 

Indeed, if ^ ^ then ^ ^ |, hence by (|9^ ) ^H{An) |log2. Conversely, if 
\im^H{AS= |log2 thenby (0) ^(c„ + t/„) ^ i, hence by (|3) ^ 0. 

Since A{X) is the CAR-algebra the weak closure of its image in the GNS-representation 
of r is the hyperfinite Ili-factor R. When we in the sequel consider the approximation 
entropies of a defined in Definition ^]2| it is really the extension of a to -R that we consider. 
While har is subadditive on tensor products the lower approximation entropy ihar only 
satisfies 

iha-r^rict <S) a) < 2ihar{a) . 
Lemma 9.1 |[NST|| , ||G-S2|| With a and X as before we have: 



(i) hr(^r{oi ®a) = log 2 

(ii) ihar{a) = |log2 

Proof. Let Aq denote the C*-subalgebra of A{X) ® A{X) generated by the symmetries 
Si ^ Si, i G Z. Then Aq is abelian, and t ® t vanishes on each Sj ® Sj. Thus the C*- 
dynamical system (Aq, t ® t, a ® a) is isomorphic to the 2-shift, hence has entropy log 2, 



hence by monotonicity /i^^^(q; ® a) > log 2. Thus by Proposition |6^ , and the inequahty 
preceeding the lemma 

2ihar{a) > £har(^T{c( ® a) > hrt^r{,(y- ® a) > log 2 . 

The converse inequality follows from easy estimates using (|9.5| ). □ 

^From the above lemma /It-(q;) G [0, | log 2]. In many cases /iT-(a) = |log2. 



Theorem. 9.2 ||CT|1 , [p-Sl|] Suppose X satisfies one of the following: X is finite, N\X 



is finite, X is contained in the even or odd numbers, X contains the odd numbers. Then 
hr{a) = \\og2. 
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Consider the case when X D {1, 3, 5, . . . }. Let tj = S2j-iS2j, j G Z. Then the tj all 
commute, and as in the proof of Lemma acts as a 2-shift on the C*-algebra they 

generate. Thus 

K{a) = iKia^) > ilog2 , 

and the conclusion follows. □ 

For other examples when hr{a) = | log 2 see 0]. If J C N is finite, J = {ii, ... , z„ : 
ii < zi < ■ ■ ■ < in} then the operator . . . or isi-^ ■ ■ ■ is self-adjoint. Denote the 
self-adjoint operator by sj. Then {Q!-'(sj)}jgz is a sequence of symmetries which either 
commute or anticommute. Let 

X(J) = {j G N : a^{sj)sj + Sja^{sj) = 0} 

be the corresponding subset of N. If / C N we denote hy I — I = {n — m : m,n E 1} . 

Theorem. 9.3 ||NST|| (i) Assume for each finite subset J C N there exists an infinite 
subset / C N such that (/ - /) n N C X(J). Then K{a) = 0. 
(ii) There exists X C N such that (i) holds. 

The proof of (i) consists of showing that the Sauvageot-Thouvenot entropy h'^{a) = 0. 
This is done by showing that a stationary coupling A corresponding to an abelian system 
{B, fi, P) necessarily is of the form A = r yU. 

If we combine Theorem with Lemma |9.1| we have 

Corollary 9.4 ||NST|| There exists X C N such that = log 2 while hr{a) = 0. 

We leave it as open problems whether there exists X C N such that < hT-{a) < 
I log 2, and whether there exists X C N such that, cf. Lemma ^]T] (ii), har{oi) > |log2. 

Another example of a C*-dynamical system {A, r, a) for which hr(^r{(y^Ci) > hr{a) + 
hr{a) = has been exhibited by Sauvageot [^, see also |P^-T2| . 

Let 6' G M and Ag be the C*-algebra generated by two unitaries U and V such that 

VU = e^^'^UV , 

so Ag is the irrational rotation algebra when 9 is irrational. If /i = (m, n) G 7? let 

We{^i) = e'^^'^'^U'^V'' . 

Then linear combinations of the Wg{^), /x G Z^, are dense in Ag. In analogy with Bo- 
goliubov automorphisms each matrix A G SL{2, Z) defines an automorphism cr^ of Ag 
by 

CTA{Wg{fl)) = Wg{Afl) . 

Ag has a canonical trace Tg such that Tg(Wg{fi)) = whenever fi ^ (0,0). We make the 
assumption that A has two real eigenvalues A and A~^ with |A| > 1. Then we have 
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Theorem. 9.5 |^a|| , |[N-T2 | With the above assumption there is a subset Q G M. for 
which the complement Q'^ has Lebesgue measure zero and Q + AQ C Q'^, with the following 
properties: 

(i) If9 eQ + AQ then h^^iaA) > . 

(a) If 9 eVL then tq is the unique invariant state and hT-g{a a) = = hT-_g{(T a) ■ 
Furthermore, in case (ii) hrg^T_g{<^A ® o"a) > 0. 



10 Generators 



Corollary p.4| shows that the tensor product formula h^^^{a0(3) = h^{a) + h^{l3) can only 
hold in special cases. By the superadditivity of h^, see (^.61), and the subadditivity of the 
approximation entropy har, the tensor product formula holds whenever the two entropies 
coincide. Since the latter is a refined version of mean entropy we may therefore expect 
the tensor product formula to hold whenever the CNT-entropy hr is a mean entropy. 

In the classical case of a probability space {X, B, /i) with a measure preserving nonsin- 
gular transformation T, a partition P is called a generator if the cr-algebra \/ T~^P = B, 

or equivalently, if A is the C*-algebra generated by the atoms in P, then \/ a* (A) = 

L°°{X,B,fi). In ||G-S2|| different candidates for nonabelian generators were considered. 

Definition 10.1 Let M be a hyperfinite von Neumann algebra with a faithful normal 
tracial state t. Let a be a r-invariant automorphism. A finite dimensional von Neumann 
suhalgebra N of M is a generator for a if 

(i) V oi\N) = M. 

n 

(ii) V a^{N) is finite dimensional whenever m < n, m, n G Z. 

i=m 

/n-1 

(ill) i7(Ar,a) = limsupi/7 V a'(^) 

n " V 

// (Hi) is replaced by 

/n-l 

(iv) H{a) = limsupiif V "*(^) 

n " V 

then N is called a mean generator. 

If is a generator then is a mean generator, and 

n-l 



H(a) = H(N, a) = lim -H { \/ a\N) ] . 

n n ^ ^ ' 



We say is a lower generator (resp. lower mean generator) if we replace lim sup by 

n 

liminf in (iii) (resp. (iv)). Recall from Definition |6.2| that if we replace rank A in the 

n 

definition of haT-{ot) and ihar{<y) by exp{H{A)) we obtained two entropies we denote by 
Har{a) and £Har{a)- An easy consequence of the definitions is then 
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Proposition 10.2 Let N G M be finite dimensional. If N is a mean generator (resp. 
lower mean generator) then H{a) = Haria) (resp. H{a) = iHar{c() ). 



Corollary 10.3 Let {Mi,Ti,ai) be W*- dynamical systems as above, i = 1,2. If ai and 
a2 have mean generators then 

Since the CNT-entropy remains the same when we imbed C*-dynamical system into 
the W*-dynamical system obtained via the GNS-representation due to the invariant state 
( p.5|) our definitions clearly make sense for AF-algebras. 

Several well-known examples of C*-dynamical systems have generators. We list a few. 

10.4 Temperley-Lieb algebras 

Let (ej)igz be a sequence of projections with the porperties. 

(a) eiCiiiej = Xet for some A G (0, \] U {|sec^(^) : m > 3} 

(b) CiCj = CjCi if |i — j| > 2. 

(c) r(co'ej) = Ar(ti;) if u; is a word in 1 and Cj, j < i. 

Then the von Neumann algebra R generated by the e^'s is the hyperfinite Ili-factor. The 
shift automorphism ax determined by a\{ei) = Cj+i has C*(eo) as a mean generator, see 



10.5 Noncommutative Bernoulli shifts 

In the notation of (2.14) assume d = 2. Let denote the centralizer of (f in Mq ® Mi. 



Then is a generator for a | G-S2 |. 



10.6 Binary shifts 



Assume as before —X U {0} U X is nonperiodic. By Theorem ^]3| and Corollary |10.3| we 



do not in general have generators for binary shifts. In the notation of ( |9.1| )-( P^ the 
following hold. 

(i) If H{a) = I log 2 then Ai is a lower mean generator. If moreover lim^ = then 
Ai is a mean generator. 

(ii) If X is contained in the even numbers then A2 is a lower generator. If moreover 
lim — = then A2 is a generator. 

n " 

(iii) If X is contained in the odd numbers then Ai is a lower generator. If moreover 
lim — = then Ai is a generator. 
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There are many ways to generalize the concept of generators. Instead of looking 

n-l 

at y a'^{N) we can consider an increasing sequence of finite dimensional algebras and 



endomorphisms instead of automorphisms. 



Definition 10.7 [p4|l Let M be a hyperfinite von Neumann algebra with a faithful normal 
tracial state. Let a be a r-invariant endomorphism. An increasing sequence {An)nm of 
finite dimensional von Neumann subalgebras of M is a generating sequence for a if 

oo 

(i) \J A^ = M, 

n=l 

(ii) a{An) C A„+i, n G N, 
(ill) H{a)=\im^H{A„). 

By (iii) it is clear that the tensor product formula holds in the presence of generating 
sequences. 

We say a sequence {An)n£N such that (i) and (ii) hold, satisfies the commuting square 
condition if the diagram 

An+l C M 

u u 

a{An) C a{An+i) 

is a commuting square for all n eN, i.e. -Ea(A„) = Ea(A„+i) ° 

With the above assumptions we can generalize the classical result that if P is a gener- 
ator for a measure preserving nonsingular transformation T on probability space {X, B, fi) 
then H{T) is given by relative entropy, 



H{T) = Urn H\ \Jt-\P)\\/T-'{P) 



In our case relative entropy is defined in Definition |2.8| . If is a von Neumann algebra 
we denote by Z{N) the center of N. 

Theorem. 10.8 Let M, r, a be as above and suppose H{a) < uj. Suppose (An)n6Nu{o} 
is a generating sequence for a satisfying the commuting square condition. Then we have: 

(i) lim -H{Z{An)) exists. 

(ii) H{a) = \H{M\a{M)) + \ lim 

n— *oo 

Furthermore, if M is of type I then H{a) = H{M\a{M)) . 



Pimsner and Popa [ P-P|| found an explicit formula for the relative entropy H{P\Q) 



when P D Q are finite dimensional C*-algebras. For the sequence (An) the formula 
becomes 

(10.1) H{An)\a{An-i)) 

= 2{H{Ar,) - H{a{A^,{)) - (if(Z(A„)) - + c„ , 
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where c„ is a real number depending on the multiphcity of the imbedding C A^. 

Since H{a{An_i)) = H{An-i) and similarly for the centers, if we add the equations in 
( |101| ) we find, 



k 



n=l 

k 

= Ih{a,) - Ih{a,) - \h{Z{A,)) + \h{z{a,)) + \Y.c^. 

nj rh Iv rh fC 

n=l 

Since (An) satisfies the commuting square condition the left side converges to H{M\a{M)), 

k 

|P-P|| . Some analysis shows ^ ^ c„ 0. Since the terms involving Aq go to zero and 



2 



^H{Ak) — > 2H{a), the proof is completed. □ 
If R is the hyperfinite lli-factor then by a formula of Pimsner and Popa [P-P|| we get 



Corollary 10.9 If in Theorem \10.^ M = R is the hyperfinite Ili-factor we have 

(i) hm-H{Z{An)) exists. 

(ii) Rn a{R)' is atomic with minimal projections fk, 'Yl fk = ^, 

k 

(ill) H{a) = H{R n a{R)') + \ E r{fk) log[i?/, : a{R) + \ lim }^H{Z{Ar,)). 

k 

Here Rf means the R cut down by /, and [P : Q] is the Jones index 0]. In particular, 
iiRna{Ry = C then 

(10.2) H{a) = i log[i? : a{R)] + \ lim . 

n n 

The natural sequences considered in Examples (10.4)-(10.6) all satisfy the commuting 
square conditions, and in (10.4) and (10.6) (|10.2| ) reduces to 

(10.3) H{a) = l\og[R: a{R)] , 



a formula which is well-known in those cases, see 0] , [P-P| 



If C M is an inclusion of type III factors with a common separating and cyclic 
vector ^ the conjugations Jm and defined by ^ define an endomorphism 7 of M into 
N by 

7(x) = JnJmxJmJn , X e M , 



see . If the index is finite Choda ||C2|| showed a formula like ( |10.3|) for the entropy of 7 



with respect to a natural invariant state. 

The Ill-analogue F of 7 is defined for an irreducible inclusion of Ili-factors C M of 
finite index. We then get a tower 

N = M_i C M = Mo C Ml C • • • 
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The trace r of M is extended naturally to a trace, also denoted by r, on each M^. The 
canonical conjugation on the Hilbert space L'^{Mk, r) is defined by JkX = x*, x E M^. 
We denote by Mqo the closure of IJ in the GNS-representation of r and consider M 

k 

as a subfactor of Moo- Let R = M' fl M^o- Then R is the hyperfinite Ili-factor, and the 
canonical shift F on i? is defined by 

r(x) = Jn+lJnXJnJn+l 

for X G M' n M2ki n > k. This definition does not depend on n. Let An = M' fl M2n- 
Then the sequence (v4„) is a generating sequence which satisfies the commuting square 
condition. It follows from Corollary 10.9 that H{r) is given by (|10.2|) . This formula was 
first shown by Hiai ||^. With certain extra assumptions he and Choda ||C2|| , ||C-H|| showed 
that H{T) is given by (|0j). 



11 The variational principle 

The variational principle appears as an important ingredient both in classical ergodic 
theory and in spin lattice systems in the C*-algebra formalism of quantum statistical 
mechanics. The principle can be well described in the finite dimensional case. Indeed, let 
5 be a finite dimensional C*-algebra and Tr^ the canonical trace on B, i.e. Trs(e) = 1 for 
all minimal projections e G -B. If is a state on B let G B^ be its density operator, 
so f{x) = Ttb{Kipx). Then the mean entropy of (p is 

Si^) = TrsiviK^)) ■ 
The variational principle takes the form: If if G -Bsa then 
(11.1) S{^)-^iH)<\ogTTBie-''), 
with equality if and only if 



In this case ip is called the Gibbs state. Note that ip is then a KMS-state at /3 = 1 for the 
one-parameter group 

where we recall that a state p on a, C*-algebra A is a KMS-state for a one-parameter 
group at at temperature P if 

ip{ab) = p{baifs{a)) 



for all analytic elements a, 6 G A, see [[B-R| , Ch. 5]. 

The above variational principle has been extended to automorphisms of C{X) when 
X is a compact metric space, see Ch. 9], and to spin lattice systems, see ||B-R| , 
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Ch. 6]. In the latter case the C*-algebra is an infinite tensor product indexed by Z*^, 
z/ G N, and the automorphism group consists of the shifts. In the years around 1970 the 
variational principle was intensely studied by mathematical physicists, see the comments 
to Section 6.2.4 in ||B-K]| , and solved in a way naturally extending the results in the finite 



dimensional case. The entropy used, was mean entropy. However, Moriya Q has shown 
that one gets the same results with CNT-entropy replacing mean entropy. 

The C*-dynamical systems {A, a) considered above are all asymptotically abelian, i.e. 
II |/]|| ^ as n — >■ cx) for all x,y & A. Following work of Neshveyev and the author 



N-S2|| we shall in the present section see that the variational principle has a natural 
extension to a class of asymptotically abelian C*-algebras. For another approach in the 



case of Cuntz-Krieger algebras see IPr'W Y|| . First we shall need to extend the right side of 



to C*-algebras. We modify the definition of topological entropy in Definition ^ 
Let ^ be a nuclear C*-algebra with unit and a an automorphism. Let 

CPA(A) = {{p,iIj,B) : B is finite dimensional C*-algebra, 

p : A B, ip : B ^ A are unital completely positive maps} 

For S > 0, u e Pf{A), and H G A^^. put 

P{H,uj,6) = inf{logTrB(e-''(^)) : {p,^,B) G CPA(A), || o p)(x) - x|| < 5,Vx G 00} 

where the inf is taken over all (p, ip, B) G CPA{A). Let 

^ n— 1 n—1 

Pa,iH,u,6) = limsup-P(^a-'(iJ), |J , 

Pa{H,u) = sup Pa{H,LJ, 6) . 
<5>0 



Definition 11.1 The pressure of a at H is 

PaiH)= sup PaiH,Lu). 

ajeP/(A) 

Note that Ttb{1) = rank B, so when H = the above definition restricts to Voiculescu's 
definition of topological entropy ht{a). The basic properties of pressure are contained in 

Proposition 11.2 The following properties are satisfied by P^ for H,K ^ A^a.- 
(i) If if is an a-invariant state of A then 

Pa{H) > h^{a) - ip{H) , 

where h^f,{a) is the CNT-entropy of a. 
(zz) IfH<K then P^{H) > P^{K). 
(ill) Pa{H + cl) = PaiH) -c, ceR. 

(iv) Pa{H) is either infinite for all H or is finite valued. 

(v) If Pa IS finite valued then \Pa{H) - Pa{K)\ < \\H - K\\. 

fc-i 

(vi) ForkeN Pak ( E (y^{H)) = kPa{H). 

j=Q 

(vii) Pa{H + a{K)-K)=Pa{H). 
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The proof of (i) is a modification of 0, Prop. 4.6] using ( p. 1 . 1| ) . The others are 
modifications of the corresponding results in the classical case, ||W| , Thm. 9.7]. In the 
proof of (ii), (v), (vi) we make use of the important Peierls-Bogoliubov inequality ||0-P| , 
Cor. 3.15], 

(11.2) logTrB(e^) < logTrB(e-^) if H <K . 

The pressure function has very strong properties, as our next result shows. 

Proposition 11.3 Suppose ht{a) < oo, and let ip he a self-adjoint linear functional on 
A. Then ip is an a-invariant state if and only if —ip{H) < Pa{H) WH G Asa- 

The proof is a good illustration of the basic properties of Pa- li ip is an a-invariant 
state then by (i) in Proposition fT^ , -^{H) < Pa{H) - h^{a) < Pa{H). 
Conversely, if —ip{H) < Pa{H) for all H then by (vii) applied to H = 0, 

-<p(a(K) -K) = --ip^a^nK) - nK) < -Pa{a{nK) - nK) 
n n 

1 , , 

= — Pq(0) ^0 as n ^ oo . 
n 

Application of this to —K yields a-invariance of (p. 
By properties (ii) and (iii) 

-ipiH) = --<p{nH) < -Pa{nH) 
n n 

< -P„(0 - n\\H\\) = -P„(0) + \\H\\ \\H\\ . 
n n 

Thus \\p>\\ < 1. Since for c G M, 

-op{l) < Paid) = ht{a) - c 
we see that (p{l) = 1, so (y9 is a state. □ 
Definition 11.4 We say an a-invariant state is an equilibrium state at H if 

Pa{H) = h^{a) - ip{H) , 

or equivalently by property (i) 

h^{a) - p>{H) = snp{h^{a) - ip{H)) , 

where the sup is taken over all a-invariant states. 

In the finite dimensional case an equilibrium state corresponds to the Gibbs state. 
Recall that if F is a real convex function on a real Banach space X then a linear 
functional / on X is called a tangent functional to F at xq & X if 

F{xo + x)- F{xo) > fix) (= f{xo + x)- /(xo)) 

for all X & X. 
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Proposition 11.5 Suppose ht{a) < oo and the pressure is a convex function on Asa- 
(i) If ip is an equilibrium state at H then — is a tangent functional to Pa at H . 
(a) If is a tangent functional for Pa at H then if is an a-invariant state. 
The proof of (i) is immediate from property (i) in Proposition |11.2| . Since Pa{H) 

Pa{H + K)- Pa{H) > {h^{a) - <f{H + K)) - {h^{a) - ^{H)) = -^{K) . 
The proof of (ii) is similar to that of Proposition |11.3 . 



With the definition and the main properties of pressure well taken care of, we now 
embark on the variational principle. The setting will be a restricted class of asymptotically 
abelian C*-algebras. 

Definition 11.6 A unital C*-dynamical system [A, a) is called asymptotically abelian 
with locality if there is a dense a-invariant *-subalgebra A of A such that for each pair 
a,b ^ A the C*-algebra they generate is finite dimensional, and for some p = p{a, b) E N 
we have [a^{a),b] = whenever \j\ > p. 

We call elements of A local operators and finite dimensional C*-subalgebras of A local 
algebras. We may add the identity 1 to A, so we assume 1 E A. Since each finite dimen- 
sional C*-algebra is singly generated an easy induction argument shows C*(ai,... ,ar) 
is a local algebra whenever oi, . . . , a,. G In particular if A is separable then A is an 
AF-algebra. A similar argument shows that for each local algebra there is p G N such 
that ^•'(A^) commutes with A^ whenever |j| > p. 

Theorem. 11.7 Let {A, a) be a unital separable C*-dynamical system which is asymp- 
totically abelian with locality. Let H G Asa- Then 

Pa{H) = sn^{h^{a) - ^{H)) , 

where the sup is taken over all a-invariant states. In particular, the topological entropy 
satisfies 

ht{a) = sup h^{a) . 

For the proof two lemmas are needed. We first consider the simplest case, which is 
close to that of shifts on infinite tensor products. To simplify notation we put for each 
G N, and local algebra A" 

k 

Hk = , Nk = C*{a^{N) ■.0<j<k). 

j=0 
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Lemma 11.8 Let A,a,H be as in Theorem 11.% Suppose there exists a local algebra N 
such that H e N, all a^{N), j ^ 0, commute with N, and C*{a^{N),j e Z) = A. Then 
there exists an a-invariant state ip such that 



P^{H) = h^ia) - viH) = ^lim ^Tr^^(e-^'=) . 
The lemma is easiest to understand if we note that 

and that the expression inside the hmit is times the pressure of in A^^ as in equation 

Lemma 11.9 Let uj G A be a finite set containing H . Let N be a local algebra with 
uj d N . Choose p G N such that a^{N) commutes with N for \j\ > p. Let k > p, and 
Mk = C*{a^\Nk-p);3 e T). Then 

Pa{H,uj) < hminf yP^k,M^{Hk^p) . 

Note that a^^{Nk~p) commutes with Nk-p for all j 7^ 0. Furthermore 
Mfc = C*{a^^+\N)- l<i<k-p,j eZ) , 
hence the a^(A^)'s which appear in are those for which 

i^[j{jk-p+l,jk-p + 2,... ,jk-l} . 

The proof consists of showing that the contribution of these i's is negligible for large 

k. 

In order to complete the proof of Theorem |11.71 apply Lemma |11.8| to Mk and a''. We 
get an a'^-invariant state ipk on such that 



-MH, 



k-p) 



By Theorem 52 and Proposition 5J we can extend tpk to an a'^-invariant state ipk on A 
such that 



Put 



^ k-1 



o a-' 



j=0 
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Then Lp^ is a-invariant, and by concavity oi (p ^ hip{aj, 



so that 



where e is smalL We then find that 

1 



sup(/i^(a) - 'p{H)) > hminf -P^k^ (Hk-p) 



and the theorem follows from Lemma 111.9 . 



Corollary 11.10 With our assumptions on {A, a) the pressure is a convex function of 
H. 

Proof. Use the affinity of the function H h^{a) — f{H). 

Let {A, a) be asymptotically abelian with locality as before and H a self-adjoint local 
operator. Put 

Then bu is a derivation on A and defines a one-parameter group of = exp{it Sh) on 
A. Let (3 > 0. We say an a-invariant state ip is an equilibrium state at H at inverse 
temperature (3 if 

P^{13H) = h^{a) - (3ip{H) (= snpih^a) - mH))) . 

Theorem. 11.11 Suppose a unital separable C*-dynamical system a) is asymptoti- 
cally abelian with locality, and ht{a) < oo. If H is a self-adjoint local operator in A and 
ip is an equilibrium state at H at inverse temperature P, then ip is a KMS-state for at 
p. In particular, if ht{a) = h^{a), then ip is a trace. 

In order to prove the theorem we may replace H by P{II) and show 99 is a KMS-state 
for cr^ at 1 . By Proposition |11.5| Theorem |11.11| is a consequence of 



Theorem. 11.12 Let A, a, H be as in Theorem If —f is a tangent functional for 

Pa at H then ip is a KMS-state for at 1. 

The proof of this theorem is modelled on the corresponding proof for spin lattice 
systems, see IP-Rj Ch. 6]. 
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Several examples encountered in the previous sections are asymptotically abelian with 
locality. They are: 



1^11.3) Shifts on (^-Bj, where Bi = Bq is an AF-algebra. 

1^11.4) Binary shifts {A{X), a) as defined in Section 9 with X C N a finite set, 
see [G-Sl]. 

^11.5) The shift on the Jones projections in the Temperley-Lieb algebra, see 10.4. 
^11.6) The canonical shift defined by a subf actor C M of finite index, see 
Section 10. 

1^11.7) Let A = K{H) + CI, where K{H) is the compact operators on a separable 
Hilbert space. Let a = Ad u\a, where U is the bilateral shift on H. 



11.13. Counter examples Theorem |11.7| is false without the assumption of asymptotic 



abelianness. Indeed Theorem p.3| provides a counter example. In that case r is the unique 
a-invariant state, and ht{a) > |log2. 



The assumption ht{a) < oo is necessary in Theorem 11.11 , as is immediate from 
example (11.3) above. If Bq is infinite dimensional there exist many a-invariant states 
with infinite entropy. 



Locality is necessary in Theorem |1 1 . 1 1| . For let U he a unitary operator on a separable 
Hilbert space H with singular spectrum such that [U^f, 5^) — *• as n — >■ 00, for all f,g & H. 
Let A be the even CAR-algebra, i.e. the fixed points in the CAR-algebra of the Bogoliubov 



automorphism see Section 4. From the proof of Lemma |4.1| we have ht{au) = 0. 



However, there exist many a(/-invariant states, e.g. all quasi-free states ux, < A < 1. 
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